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@ Method of and apparatus for providing automatic detection and processing of an empty multimedia 
data object 



(57) Method of,, and apparatus for, providing auto- 
matic detection and processing of an empty 
multimedia data object. The present invention 
determines the data type of a multimedia data 
object. The present invention also detects 
whether the multimedia data object, or a com- 
ponent thereof, is empty based upon its data 
type. The present invention also appropriately 
processes a detected empty multimedia data 
object, or a component thereof. The approp- 
riate processing may include no action, inform- 
ing a user, program, or device of a detected 
empty multimedia data object, or a component 
thereof, inhibiting further processing of a detec- 
ted empty multimedia data object, or a compo- 
nent thereof, or deleting a detected empty 
multimedia data object, or a component there- 
of. 
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This invention relates in general to multimedia 
data processing systems, and in particular to a meth- 
od of, and apparatus for, providing automatic detec- 
tion and processing of an empty multimedia data ob- 
ject 

Conventional data processing systems may pro- 
vide input capabilities for entering data objects into a 
system, processing capabilities for storing and manip- 
ulating data objects within the system, and output ca- 
pabilities for displaying, printing, or communicating 
data objects from the system. Herein, data object also 
means a component of a data object However, when 
a data object, or component of a data object, is empty, 
conventional data processing systems do not provide 
a comprehensive capability for detecting and appro- 
priately processing an empty data object or empty 
component of a data object Herein, empty means 
that a data object contains no useful information or 
that a data object contains a marker indicating that 
the data object is effectively empty. This is a problem 
in that an empty data object that contains no useful 
information is wasting valuable system resources 
when the empty data object is entered into, stored in, 
manipulated in, or outputted from a system. This is 
also a problem in that' an empty data object may 
waste user time and effort This is also a problem in 
that an empty data object may represent the inadver- 
tent loss of valuable information. 

The prior art has not recognized these problems. 
The prior art consists of incomplete fragmented solu- 
tions which do not recognize nor address the full 
scope of the problems. The state of the prior art is 
demonstrated by printer ribbon "inhibitors, printer 
head inhibitors, EOJ (End of Job) separator page in- 
hibitors, and copier duplex sheetfeed mechanisms. 

Printer ribbon inhibitors detect blank characters in 
a line to be printed and deactivate the movement of a 
printerprinter ribbon which normally moves after each 
character is printed. This deactivation allows the por- 
tion of the printer ribbon that was not used by a blank 
character to be used to print the next character. How- 
ever, blank characters are still printed by the printer. 
If an entire line consists of only blank characters, the 
blank lines are still printed by the printer. If an entire 
page consists of only blank lines, then an entire blank 
page is still printed by the printer. If an entire docu- 
ment consists of only blank pages, then an entire 
blank document is still printed by the printer. Although 
a printer ribbon inhibitor allows full utilization of a prin- 
ter ribbon, it does not detect empty data objects, nor 
does it prevent the waste of system resources con- 
sumed in printing a blank document. These wasted re- 
sources include the printer utilization time and the pa- 
per. 

Printer head inhibitors detect blank lines In a 
document to be printed and deactivate the printer 
head during the printing of the blank line. This deac- 
tivation saves wear and tear on the printer head and 
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extends its operational life. However, the blank lines 
are still printed by the printer. If an entire page con- 
sists of only blank lines, then an entire .lank page is 
still printed by the printer. If an entire document con- 
5 sists of only blank pages, then an entire blank docu- 
ment is still printed by the printer. Although a printer 
head inhibitor saves wear and tear on a printer head, 
it does not detect empty data objects, nor does it pre- 
vent the waste of system resources consumed in 
10 printing a blank document These wasted resources 
include the printer utilization time and the paper. 

EOJ separator page inhibitors suppress the in- 
sertion and printing of EOJ separator pages between 
printer tasks by a printer spooler. Some printer spool- 
15 ers automatically insert EOJ separator pages be- 
tween sequential printer tasks printed by a batch prin- 
ter. The printing of EOJ separator pages causes the 
end of the prior printer task to be ejected from a printer 
housing so that the prior printer task may be removed 
20 from the printer. Otherwise, one would have to wait 
until the printing "of the next printer task caused the 
end of the prior printer task to be ejected. If the next 
printer task immediately follows the prior printer task, 
then the next printer task will eject the prior printer 
25 task, thus removing the need for EOJ separator pa- 
ges between these two immediately sequential printer 
tasks. Hence, the need for EOJ separator page inhib- 
itors to inhibit the printing of EOJ separator pages be- 
tween immediately sequential batch printer tasks. 
30 However, the EOJ separator pages are not included 
in the original data objects to be printed. Further- 
more, the EOJ separator pages are commonly not 
blank pages, but instead contain information identify- 
ing the next printer task. Therefore, EOJ separator 
35 page inhibitors do not either detect or process empty 
data objects. 

Some copier duplex sheetfeed mechanisms de- 
tect the difference between double sided originals 
versus single sided originals so that a copier may de- 
40 termine whether to copy either both sides or just one 
side of the original. These sheetfeed mechanisms 
use a blank line sensor (an electronic white space de- 
tector) to determine if an entire side of an original is 
blank. In an original having a blank surface on one 
45 side only, the side having an image is processed with- 
out executing the image processing of white paper on 
the other side which does not have an image to be 
copied. Although these sheetfeed mechanisms may 
detect a blank original, they cannot detect empty data 
50 objects stored in electronic form, nor empty multime- 
dia data objects. They also cannot inhibit output proc- 
essing of blank originals. In addition, the blank line 
sensor is separate from and operates before any im- 
age processing of the original. 
55 For a situation which may call for detection and 

processing of empty data objects, consider t he follow- 
ing situations. Currently within a data processing sys- 
tem, an originator of a distribution may advertently or 
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inadvertently send a empty data object, such as a 
document that has a multitude of blank pages. These 
pages may be of no interest to the recipient of the dis- 
tribution. In particular, this problem occurs frequently 5 
in facsimile transmissions. The originator may wish to 
fax a bulk of documents without viewing the individual 
pages. Some pages may be blank, thus causing the 
originator's system to scan, store, manipulate, and 
transmit "blank pages. This also causes the reci- 10 
pient's system to receive, store, manipulate, and per- 
haps print blank pages. The originator of a facsimile 
transmission may inadvertently place the docu- 
ments "wrong side up" into the facsimile device, thus 
causing both the originator's system and the reci- 15 
pient's system to process entire documents that con- 
sist of blank pages. This problem may also occur for 
other image data objects. For example, a scanner 
may scan a document containing blank pages or an 
entire blank document This problem is not limited to 20 
image data objects, it may also occur with text data 
objects, video data objects, audio data objects, or 
multimedia data objects. This problem may also occur 
during the input, output, or system processing of an 
empty data object. 25 

The prior art approaches described above pres- 
ent the user with four difficulties. The first difficulty 
is that the prior art approaches generally do not de- 
tect empty data objects. They detect and respond to 
aspects of an empty data object, but they also detect 30 
and respond to those same aspects in data objects 
which are not empty. For example, although a printer 
ribbon inhibitor detects blank characters in a blank 
page, it also detects blank characters in a non-empty 
page consisting of both blank characters and non- 35 
blank characters. Although a printer head inhibitor de- 
tects blank lines in a blank page, it also detects blank 
lines in a non-empty page consisting of both blank 
lines and non-blank lines. Although a copier duplex 
sheetfeed mechanism may detect both blank sides of 40 
a blank original, it also detects the single blank side 
of a non-empty single sided original. The second dif- 
ficulty is that not detecting empty data objects allows 
the system to further process these empty data ob- 
jects. The third difficulty is that this processing 45 
wastes both valuable system resources and user re- 
sources, which may have been avoided if the empty 
data objects had been detected. The fourth difficulty 
is that not detecting empty data objects may allow a 
loss of valuable information to go undetected. so 

Thus the prior art provides no method of, or ap- 
paratus for, automatic detection and processing of an 
empty multimediadata objects. As such, there is a 
need for a method of, and apparatus for, providing au- 
tomatic detection and processing of empty multime- 55 
dia data objects. 

The invention disclosed herein comprises a 
method of, and apparatus for, providing automatic de- 
tection and processing of empty multimedia data ob- 



jects. Herein, a multimedia data object means a data 
object comprising one or more different types of data 
objects. These types may comprise text, graphics, im- 
age, video, audio, etc. The method and apparatus de- 
scribed herein substantially eliminate or reduce the 
difficulties encountered in conventional systems 
when empty data objects are not detected by provid- 
ing automatic detection and processing of empty mul- 
timedia data objects. 

In accordance with one aspect of the present in- 
vention, automatic detection and processing of an 
empty multimedia data object is provided. 

Another aspect of this invention is that determi- 
nation of the data type of an empty multimedia data 
object is provided. 

Yet another aspect of this invention is that auto- 
matic detection of an empty multimedia data object 
based upon its data type is provided. 

Yet another aspect of this invention is that spec- 
ification of appropriate processing for a detected 
empty multimedia data object is provided. 

Yet another aspect of this invention is that the 
specification of appropriate processing may include 
no action, informing a user, program, or device of a 
detected empty multimedia data object, inhibiting fur- 
ther processing of a detected empty multimedia data 
object, or deleting a detectedempty multimedia data 
object 

The present invention has the advantage of al- 
lowing automatic detection of an empty multimedia 
data object 

The present invention has the further advantage 
of allowing a user, application program, operating sys- 
tem program, device driver, or device to be informed 
of an empty multimediadata object. 

The present invention has the further advantage 
of allowing a user, application program, operating sys- 
tem program, device driver, ordevice to inhibitfurther 
processing of an empty multimedia data object. 

The present invention has the further advantage 
of allowing a user, application program, operating sys- 
tem program, "device driver, or device to initiate emp- 
ty multimedia data object specif ic processing of an 
empty multimedia data object 

The present invention has the further advantage 
of allowing a user, application program, operating sys- 
tem program, device driver, or device to delete an 
empty multimedia data object 

The present invention has the further advantage 
of detecting an empty multimedia data object in the in- 
put, memory, storage, or output of a data processing 
system. 

The present invention has the further advantage 
that it may be implemented as a system filter. 

For a more complete understanding of the pres- 
ent invention and the advantages thereof, reference 
is now made to the Detailed Description in conjunc- 
tion with the attached Drawings, in which: 
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Figure 1 is a flow chart illustrating the operations 
preferred in carrying out the present invention; 
Figure 2 is a flow chart illustrating the operations 
preferred in carrying out the Separator Routine 5 
portion of the present invention; 
Figure 3 is a flow chart illustrating the operations 
preferred in carrying outthe Empty FilterRoutine 
portion of the present invention; 
Figure 4 is a flow chart illustrating the operations 10 
preferred in carrying out the Empty Text Filter 
Routine portionof the present invention; 
Figure 5 is a flow chart illustrating the operations 
preferred in carrying outthe Empty Non-Text Im- 
age Filter Routine portion of the present inven- 15 
tion; 

Figure 6 is a flow chart illustrating the operations 
preferred in carrying out the Empty Text Image 
Filter Routine portion of the present invention; 
Figure 7 is a flow chart illustrating the operations 20 
preferred in carrying out the Empty Video Filter 
Routine portion of the present invention; 
Figure 8 is a flow chart illustrating the operations 
preferred in carrying out the Empty Audio Filter 
Routine portion of the present invention; and 25 
Figure 9 is a block diagram of a computer system 
used in performing the method of the present in- 
vention and forming part of the apparatus of the 
present invention. 

Referring first to Figure 1 through Figure 8, flow- so 
charts illustrating operations preferred in carrying out 
the present invention are shown. In the flowcharts, 
the graphical conventions of a diamond for a test or 
decision and a rectangle for a process or function are 
used. These conventions are well understood by 35 
those skilled in the art, and the flowcharts are suffi- 
cient to enable one of ordinary skill to write code in 
any suitable computer programming language. 

The operations preferred in carrying outthe pres- 
ent invention may be implemented as nine processes, 40 
programs, or routines comprising a Main Program, a 
Separator Routine, an Empty Filter Routine, an Emp- 
ty Text Filter Routine, an Empty Non-Text Image Filter 
Routine, an Empty Text Image FilterRoutine, an Emp- 
ty Video Filter Routine, and an Empty Audio Filter 45 
Routine. The Main Program, illustrated in Figure 1 , 
determines a data type of a multimedia data object 
and directs appropriate processing of either a single 
type multimedia data object or a mixed type multime- 
dia data object. The Separator Routine, illustrated in so 
Figure 2, separates a data object into components. 
For example, a text data object may be separated into 
pages, or a video data object may be separated into 
video frames. The Empty Filter Routine, illustrated in 
Figure 3, either calls an appropriate type of data ob- 55 
ject filter or informs that the data object is not a sup- 
ported data type. The Empty Text Filter Routine, illu- 
strated in Figure 4, determinesif a text type data ob- 
ject, or a component thereof, such as a page, is emp- 



ty. The Empty Non-Text Image Filter Routine, illustrat- 
ed in Figure 5, determines if a non-text image type 
data object, or a component thereof, such as a page, 
is empty. 

The Empty Text Image Filter Routine, illustrated 
in Figure. 6, determines if a text image type data ob- 
ject, or a component thereof, such as a page, is emp- 
ty. The Empty Video Filter Routine, illustrated in Fig- 
ure 7, determines if a video type data object, or a com- 
ponent thereof, such as a video frame, is empty. The 
Empty Audio Filter Routine, illustrated in Figure 8, de- 
termines if an audio type data object, or a component 
thereof, such as an audio packet, is empty. 

As shown in Figure 1, which illustrates the oper- 
ations preferred in carrying out the Main Program 
portion of the "present invention, after the start of the 
program, decision block 110 determines if a data ob- 
ject is a single type data object If the data object is a 
single type data object, then process block 120 sets 
an Empty Filter Mode equal to the data type of the 
single type data object. Thereafter, process block 130 
calls the Separator Routine, passing the Empty Filter 
Mode and the data object. After control of the pro- 
gram returns from the Separator Routine to the Main 
Program, the program stops. Alternatively, the pro- 
gram may become dormant awaiting the next data 
object rf it is an active process in a multiprocess sys- 
tem. 

Returning now to decision block 11 0, if a data ob- 
ject is not a single type data object, then the data ob- 
ject is a mixed type data object and process block 140 
determines the number of data types of the mixed 
type data object. Thereafter, process block 1 50 initial- 
izes a Type Index by setting the Type Index equal to 
one. Thereafter, process block 160 sets the Empty 
Filter Mode equal to a data type of the mixed type 
data object as indexed by the Type Index. For exam- 
ple, during its first execution, process block 160 sets 
the Empty Filter Mode equal to the first data type of 
the mixed type data object Thereafter, process block 
170 calls the Separator Routine, passing the Empty 
Filter Mode and the data object After control of the 
program returns from the Separator Routine to the 
Main Program, process block 180 increments the 
Type Index by one. Thereafter, decision block 1 90 de- 
termines if the Type Index is less than or equal to the 
number of data types of the mixed type data object. 
If the Type Index is not less than or equal to the num- 
ber of data types of the mixed type data object, then 
the program stops. If the Type Index is less than or 
equal to the number of data types of the mixed type 
data object, then the program loops back to process- 
ing block 160 to process the next data type of the 
mixed type data object. 

Referring next to Figure 2, which illustrates the 
operations preferred in carrying out the Separator 
Routine portion of the present invention, after the 
start of the routine, process block 210 separates a 
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data object into its components. For example, a text 
data object may be separated into pages, or a video 
data object may be separated into video frames. 
Thereafter, process block 220 gets the next compo- 
nent of the data object For example, during its first 
execution, "process block 220 gets the first page of a 
text data object or the first frame of a video data ob- 
ject Thereafter, process block 230 calls the Empty 
Filter Routine, passing the Empty Filter Mode and the 
data object component. After control of the program 
returns from the Empty Filter Routine to the Separa- 
tor Routine, decision block 240, determines if an 
Empty Rag has been set equal to "True" by the Emp- 
ty Filter Routine, indicating that the data object com- 
ponent is empty. If the Empty Flag has not been set 
equal to True" by the Empty Filter Routine, indicat- 
ing that the data object component is not empty, then 
process block 250 copies the component into a reten- 
tion buffer. Thereafter, decision block 260 determines 
if all components of the data object have been proc- 
essed. If all components of the data object have been 
processed, then the routine returns to the Main Pro- 
gram that called it. If all components of the data object 
have not been processed, then the routine loops back 
to process block 220 to process the next component. 

Returning now to decision block 240, if the Empty 
Flag has been set equal to "True" by the Empty Filter 
Routine, indicating that the data object component is 
empty, then decision block 270 determines if elimin- 
ation or deletion of the empty data object component 
is desired. If elimination or deletion of the empty data 
object component is not desired, then processing 
block 280 notifies the user of the existence of the 
empty data object component 

Thereafter, the routine proceeds to process block 
250 to copy the empty data object component into the 
retention buffer, as deletion was not desired. 

Returning now to decision block 270, if elimina- 
tion or deletion of the empty data object component 
is desired, then processing block 290 effectively de- 
letes the empty data object component by not copying 
it into the retention buffer. Alternatively, if the Sepa- 
rator Routine did not use a retention buffer, process- 
ing block 290 may overwrite the empty data object 
component with a next component which is not emp- 
ty, thus deleting the empty component Thereafter, 
the routine loops back to processing block 220 to get 
the next data object component 

Referring next to Figure 3, which illustrates the 
operations preferred in carrying out the Empty Filter 
Routine "portion of the present invention, after the 
start of the routine, decision block 305 determines if 
the Empty Filter Mode is set equal to Text". If the 
Empty Filter Mode is set equal to Text", then proc- 
essing block 335 calls the Empty Text Filter Routine, 
passing the data object component After control of 
the program returns from the Empty Text Filter Rou- 
tine to the Empty Filter Routine, the Empty Filter Rou- 



tine returns to the Separator Routine that called it, 
passing back the Empty Flag. 

Returning now to decision block 305, if the Empty 

5 Filter Mode is not set equal to Text", decision block 
310 determinesif the Empty Filter Mode is set equal 
to Text Image". If the Empty Filter Mode is set equal 
to Text Image", then processing block 340 calls the 
Empty Text Image Filter Routine, passing the data ob- 

10 ject component After control of the program returns 
from the Empty Text Image Filter Routine to the Emp- 
ty Filter Routine, the Empty Filter Routine returns to 
the Separator Routine that called it, passing back the 
Empty Flag. 

15 Returning now to decision block 310, if the Empty 

Filter Mode is not set equal to Text Image", decision 
block 315 determines if the Empty Filter Mode is set 
equal to "Non-Text Image". If the Empty Filter Mode 
is set equal to "Non-Text Image", then processing 

20 block 345 calls the Empty Non-Text Image Filter Rou- 
tine, passing the data object component After control 
of the program returns from the Empty Non-Text Im- 
age Filter Routine to the Empty Filter Routine, the 
Empty Filter Routine returns to the Separator Routine 

25 that called it, passing back the Empty Flag. 

Returning now to decision block 31 5, if the Empty 
Filter Mode is not set equal to "Non-Text Image", de- 
cision block 320 determines if the Empty Filter Mode 
is set equal to "Video". If the Empty Filter Mode is set 

30 equal to "Video", then processing block 350 calls the 
Empty Video Filter Routine, passing the data object 
component After control of the program returns from 
the Empty Video Filter Routine to the Empty Filter 
Routine, the Empty Filter Routine returns to the Sep- 

35 arator Routine that called it, passing back the Empty 
Flag. 

Returning now to decision block 320, if the Empty 
Filter Mode is not set equal to "Video", decision block 
325 determinesif the Empty Filter Mode is set equal 

40 to "Audio". If the Empty Filter Mode is set equal to "Au- 
dio", then processing block 355 "calls the Empty Au- 
dio Filter Routine, passing the data object compo- 
nent. After control of the program returns from the 
Empty Audio Filter Routine to the Empty Filter Rou- 

45 tine, the Empty Filter Routine returns to the Separator 
Routine that called it, passing back the Empty Flag. 

Returning now to decision block 325, if the Empty 
Filter Mode is not set equal to "Audio", then process- 
ing block 330 notifies a user that the data object is a 

50 non-supported type. A non-supported type of data 
object is one for which the program does not provide 
automatic detection and processing of an empty mul- 
timedia data object. Processing block 330 also sets 
the Empty Flag equal to "False" so that the non-sup- 

55 ported data object or its component is copied into the 
retention buffer. Alternatively, additional data object 
types and their corresponding filters may be added to 
the program so that they become supported types of 
data objects. Thereafter, the Empty Filter Routine re- 
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turns to the Separator Routine that called it, passing 
back the Empty Flag. 

Referring next to Figure 4, which illustrates the 
operations preferred in carrying out the Empty Text 5 
Filter Routine portion of the present invention, after 
the start of the routine, processing block 410 sets an 
index to the beginning of a text type data object com- 
ponent Thereafter, processing block 420 sets a coun- 
ter equal to zero. Thereafter, decision block 430 de- 10 
termines if a character, at a position in the text data 
object indicated by the index, is other than a space 
or control character. If the character, at the position in 
the text data object indicated by the index, is a space 
or control character, then processing block 440 incre- 1 5 
ments the index. Thereafter, decision block 450 de- 
termines if the end of the text data object component 
has been reached. If the end of the text data object 
component has been reached, then decision block 
460 determines if the counter is greater than zero. If 20 
the counter is greater than zero, then processing 
block 470 sets the Empty Flag equal to "False". 
Thereafter, the Empty Text Filter Routine returns to 
the Empty Filter Routine that called it, passing back 
the Empty Flag. 25 

Returning now to decision block 460, if the coun- 
ter is not greater than zero, then processing block 490 
sets the Empty Rag equal to True". Thereafter, the 
Empty Text Filter "Routine returns to the Empty Filter 
Routine that called it, passing back the Empty Flag. 30 

Returning now to decision block 450, if the end of 
the text data object component has not been reached, 
then the routine loops back to decision block 430 to 
process the next character. 

Returning now to decision block 430, if the char- 35 
acter, at the position in the text data object indicated 
by the index, is other than a space or control charac- 
ter, then processing block 480 increments the coun- 
ter. Thereafter, the routine proceeds to decision block 
450 to determine if the end of the text object compo- 40 
nent has been reached. 

Referring next to Figure 5, which illustrates the 
operations preferred in carrying out the Empty Non- 
Text Image Filter Routine portion of the present inven- 
tion, after the start of the routine, processing block 45 
510 sets an index to the beginning of a non-text image 
type data object component. Thereafter, processing 
block 520 sets a counter equal to zero. Thereafter, de- 
cision block 530 determines if a pixel, at a position in 
the non-text image data object indicated by the index, so 
is other than white or a low-level grey scale. This de- 
termination may be accomplished by use of a print 
contrast ratio, which is well known in the art. A print 
contrast ratio is obtained by subtracting a ref jectance 
at an inspection area from a maximum reflectance 55 
found within a specified distance from that area, and 
by dividing the result by the maximum reflectance. If 
the pixel, at the position in the non-text image data 
object indicated by the index, is white or a low-level 



grey scale, then processing block 540 increments the 
index. Thereafter, decision block 550 determines if 
the end of the non-text image data object component 
has been reached. If the end of the non-text image 
data object component has been reached, then deci- 
sion block 560 determines if the counter is greater 
than zero. If the counter is greater than zero, then 
processing block 570 sets the Empty Flag equal to 
"False". Thereafter, the Empty Non-Text Image Filter 
Routine returns to the Empty Filter Routine that 
called it, passing back the Empty Flag. 

Returning now to decision block 560, if the coun- 
ter is notgreaterthan zero, then processing block 590 
sets the Empty Flag equal to "True". Thereafter, the 
Empty Non-Text Image "Filter Routine returns to the 
Empty Filter Routine that called it, passing back the 
Empty Flag. 

Returning now to decision block 550, if the end of 
the non-text image data object component has not 
been reached, then the routine loops back to decision 
block 530 to process the next pixel. 

Returning now to decision block 530, if the pixel, 
at the position in the non-text image data object indi- 
cated by the index, is other than white or a low-level 
grey scale, then processing block 580 increments the 
counter. Thereafter, the routine proceeds to decision 
block 550 to determine if the end of the non-text im- 
age object component has been reached. 

Referring next to Figure 6, which illustrates the 
operations preferred in carrying out the Empty Text 
Image Filter Routine portion of the present invention, 
after the start of the routine, processing block 610 
calls the Empty Non-Text Image Filter Routine, pass- 
ing the text image data object component. After con- 
trol of the program returns from the Empty Non-Text 
Image Filter Routine to the Empty Text Image Filter 
Routine, decision block 620 determines if the Empty 
Flag returned by the Empty Non-Text Image Filter 
Routine is equal to "False". If the Empty Flag returned 
by the Empty Non-Text Image Filter Routine is not 
equal to "False", then the Empty Text Image Filter 
Routine returns to the Empty Filter Routine that 
called it, passing back the Empty Flag. 

Returning now to decision block 620, if the Empty 
Flag returned by the Empty Non-Text Image Filter 
Routine is equal to "False", then processing block 630 
calls an OCR (Optical Character Recognition) routine. 
The OCR routine converts the text image data object 
component into a text data object component and re- 
turns the text data object component to the Empty 
Text Image Filter Routine. Such OCR routines are well 
known to those skilled in the art Alternatively, the 
OCR routine may be modified to recognize specific 
character strings or symbols indicating a blank text 
data object component. Examples of such text strings 
are This page intentionally blank". The OCR routine 
may contain a table of such strings or symbols. There- 
after, processing block 640 calls the Empty Text Filter 
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Routine, passing converted text data object compo- 
nent. After control of the program returns from the 
Empty Text Filter Routine to the Empty Text Image Fil- 
ter Routine, the Empty Text "Image Filter Routine re- 
turns to the Empty Filter. Routine that called it, pass- 
ing back the Empty Flag returned by the Empty Text 
Filter Routine. 

The purpose of processing block 610 is to detect 
an empty text image data object component that does 
not require OCR processing to detect that it is empty, 
thus eliminating the unnecessary OCR processing in 
this situation. An example of such an empty text im- 
age data object component is a totally blank image. 
However, an empty text image data object component 
may be still be empty, yet not detected by processing 
block 610, due to smudges, image noise, or specific 
character strings indicating a blank text data object 
component. Thus the need for processing block 630. 

An alternative embodiment of the Empty Text Im- 
age Filter Routine is the Empty Non-Text Image Filter 
Routine illustratedin Figure 5. Such an alternative em- 
bodiment does not include the OCR processing. 

Another alternative embodiment of the Empty 
Text Image Filter Routine is the two step sequence - 
consisting of processing block 630 and processing 
block 640 as illustrated in Figure 6. Such an alterna- 
tive embodiment does not include the Empty Non- 
Text Image Filter call to eliminate unnecessary OCR 
processing. 

Referring next to Figure 7, which illustrates the 
operations preferred in carrying out the Empty Video 
Filter Routine portion of the present invention, after 
the start of the routine, process block 705 sets the 
Empty Flag equal to "False". Thereafter, decision 
block 710 determines if a Video Test Flag is equal to 
"Random Based Test". The Video Test Flag is a user 
configurable parameter which selects one of three 
types of tests to determine if a video data object com- 
ponent is empty. The three tests are a randomness 
test, a time domain noise pattern comparison test, 
and a frequency domain noise pattern comparison 
test. An alternative embodiment may include only one 
or two of these tests. 

If the Video Test Flag is equal to "Random Based 
Test", then processing block 715 calculates the ran- 
domness of the video data object component. Meth- 
ods and algorithms for calculating the randomness of 
an information signal such as a video signal are well 
known to those skilled in the art. 

Thereafter, decision block 720 determines if the 
randomness, calculated by processing block 715, is 
greater than a randomness threshold. The random- 
ness threshold is configurable by a user. If the ran- 
domness, calculated by processing block 715, is 
greater than a randomness threshold, then process- 
ing block 725 sets the Empty Flag equal to True". 

Thereafter, the Empty Video Filter Routine re- 
turns to the Empty Filter Routine that called it, pass- 



ing back the Empty Flag. 

Returning now to decision block 720, if the ran- 
domness, calculated by processing block 715, is not 
5 greater than the randomness threshold, then the 
Empty Video Filter Routine returns to the Empty Filter 
Routine that called it, passing back the Empty Flag. 

Returning now to decision block 7 10, if the Video 
Test Rag is not equal to "Random Based Test", then 
10 decision block 730 determines if the Video Test Flag 
is equal to "Time Based Test". If the Video Test Flag 
is equal to 'Time Based Test", then processing block 
735 calculates a comparison match, via pattern rec- 
ognition, between the video data object component 
15 (video frame) and a known video noise pattern. Meth- 
ods and algorithms for calculating such a pattern rec- 
ognition comparison match are well known to those 
skilled in the art 

Thereafter, decision block 740 determines if the 
20 comparison match, calculated by processing block 
735, is greater than a comparison match threshold. 
The comparison match threshold is configurable by a 
user. If the comparison match, calculated by process- 
ing block 735, is greater than a comparison match 
25 threshold, then processing block 745 sets the Empty 
Flag equal to "True". Thereafter, the Empty Video Fil- 
ter Routine returns to the Empty Filter Routine that 
called it, passing back the Empty Flag. 

Returning now to decision block 740, if the com- 
30 parison match, calculated by processing block 735, is 
not greater than the comparison match threshold, 
then the Empty Video Filter Routine returns to the 
Empty Filter Routine that called it, passing back the 
Empty Flag. 

35 Returning now to decision block 720, if the Video 

Test Flag is not equal to "Time Based Test", then de- 
cision block 750 determines if the Video Test Flag is 
equal to "Frequency Based Test", if the Video Test 
Flag is not equal to "Frequency Based Test", then a 
40 user is informed of a configuration error. If "the Video 
Test Flag is equal to "Frequency Based Test", then 
processing block 755 calculates a frequency spec- 
trum of the video data object component Methods 
and algorithms for calculating such a frequency spec- 
45 trum, such as a Fourier Transform, Fast Fourier 
Transform, or Winnograd Transform, are well known 
to those skilled in the art Thereafter, processing 
block 760 calculates a comparison match, via pattern 
recognition, between the frequency spectrum of the 
50 video data object component (video frame) and a fre- 
quency spectrum of a known video noise pattern. 
Methods and algorithms for calculating such a pat- 
tern recognition comparison match are well known to 
those skilled in the art. 
55 Thereafter, decision block 765 determines if the 

comparison match, calculated by processing block 
760, is greater than a comparison match threshold. 
The comparison match threshold is configurable by a 
user. If the comparison match, calculated by process- 
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ing block 765, is greater than a comparison match 
threshold, then processing block 770 sets the Empty 
Flag equal to "True". Thereafter, the Empty Video Fil- 
ter Routine returns to the Empty Filter Routine that 5 
called it, passing back the Empty Flag. 

Returning now to decision block 765, if the com- 
parison match threshold, calculated by processing 
block 760, is not greater than the comparison match 
threshold, then the Empty Video Filter Routine re- w 
turns to the Empty Filter Routine that called it, pass- 
ing back the Empty Flag. 

Referring next to Figure 8, which illustrates the 
operations preferred in carrying out the Empty Audio 
Filter Routine portion of the present invention, after 15 
the start of the routine, process block 805 sets the 
Empty Flag equal to "False". Thereafter, decision 
block 810 determines if a Audio Test Flag is equal to 
"Amplitude Based Test". The Audio Test Flag is a user 
configurable parameter which selects one of three 20 
types of tests to determine if an audio data object 
component is empty. The three tests are a amplitude 
test, a power test, and a frequency domain noise pat- 
tern comparison test An alternative embodiment may 
include only one or two of these tests. 25 

If the Audio Test Flag is equal to "Amplitude 
Based Test", then processing block B1 5 calculates an 
average amplitude of the audio data object compo- 
nent. Alternatively, this average "amplitude may be 
calculated over a user configurable time interval. 30 
Methods and algorithms for calculating the average 
amplitude of an audio signal are well known to those 
skilled in the art 

Thereafter, decision block 820 determines if the 
average amplitude, calculated by processing block 35 
815, is less than an amplitude threshold. The ampli- 
tude threshold is configurable by a user. If the aver- 
age amplitude, calculated by processing block 815, is 
less than the amplitude threshold, then processing 
block 825 sets the Empty Flag equal to "True". 

Thereafter, the Empty Audio Filter Routine re- 
turns to the Empty Filter Routine that called it, pass- 
ing back the Empty Flag. 

Returning now to decision block 820, if the aver- 
age amplitude, calculated by processing block 815, is 
not less than the amplitude threshold, then the Emp- 
ty Audio Filter Routinereturns to the Empty Filter Rou- 
tine that called it, passing back the Empty Flag. 

Returning now to decision block 81 0, if the Audio 
Test Flag is not equal to "Amplitude Based Test", then 
decision block 830 determines if the Audio Test Flag 
is equal to "Power Based Test". If the Audio Test Flag 
is equal to "Power Based Test", then processing block 
835 calculates an average power of the audio data 
object component. Alternatively, this average power 
may be calculated over a user configurable time inter- 
val. 

Methods and algorithms for calculating the aver- 
age power of an audio signal are well known to those 



skilled in the art 

Thereafter, decision block 840 determines if the 
average power, calculated by processing block 835, 
is less than a power threshold. The power threshold 
is configurable by a user. If the average power, cal- 
culated by processing block 835, is less than the pow- 
er threshold, then processing block 845 sets the 
Empty Flag equal to True". Thereafter, the Empty 
Audio Filter Routine returns to the Empty Filter Rou- 
tine that called it, passing back the Empty Flag. 

Returning now to decision block 840, if the aver- 
age power, calculated by processing block 835, is not 
less than the power threshold, then the Empty Audio 
Filter Routine returns to the Empty Filter Routine that 
called it, passing back the Empty Flag. 

Returning now to decision block 820, if the Audio 
Test Flag is not equal to "Power Based Test", then de- 
cision block "850 determines if the Audio Test Flag is 
equal to "Frequency Based Test". If the Audio Test 
Flag is not equal to "Frequency Based Test", then a 
user is informed of a configuration error. If the Audio 
Test Flag is equal to "Frequency Based Test", then 
processing block 855 calculates a frequency spec- 
trum of the audio data object component Methods 
and algorithms for calculating such a frequency spec- 
trum, such as a Fourier Transform, Fast Fourier 
Transform, or Winnograd Transform, are well known 
to those skilled in the art Thereafter, processing 
block 860 calculates a comparison match, via pattern 
recognition, between the frequency spectrum of the 
audio data object component (audio packet) and a fre- 
quency spectrum of a known audio noise pattern. 
Methods and algorithms for calculating such a pat- 
tern recognition comparison match are well known to 
those skilled in the art. 

Thereafter, decision block 865 determines if the 
comparison match, calculated by processing block 
860, is greater than a comparison match threshold. 
The comparison match threshold is configurable by a 
user. If the comparison match, calculated by process- 
ing block 865, is greater than a comparison match 
threshold, then processing block 870 sets the Empty 
Flag equal to "True". Thereafter, the Empty Audio Fil- 
ter Routine returns to the Empty Filter Routine that 
called it, passing back the Empty Flag. 

Returning now to decision block 865, if the com- 
parison match threshold, calculated by processing 
block 860, is not greater than the comparison match 
threshold, then the Empty Audio Filter Routine re- 
turns to the Empty Filter Routine that called it, pass- 
ing back the Empty Flag. 

Referring now to Figure 9, there is shown in block 
diagram form, a data processing system 900 accord- 
ing to the presentinvention. The data processing sys- 
tem 900 includes a processor 902, which includes a 
central processing unit (CPU) 904, and a memory 
906. Additional memory, in the form of a hard disk file 
storage 908 and a floppy disk device 910, is connect- 
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ed to the processor 902. Floppy disk device 910 re- 
ceives a diskette 912 which has computer program 
code recorded thereon that implements the present 
invention in the data processing system 900. The data 
processing system 900 includes user interface hard- 
ware, including a mouse 914 and a keyboard 916 for 
allowing user input to the processor 902 and a display 
918-for "presenting visual data to the user. The data 
processing system may also include a printer 920 for 
printing information. The data processing system 900 
may also include image devices, including a scanner 
924 for scanning images into the data processing sys- 
tem 900 and an image/fax printer 924 for printing im- 
ages. The data processing system 900 may also in- 
clude video devices, including a video input device 
926 for entering video into the data processing sys- 
tem 900 and a video output device 928 for displaying 
video. The data processing system 900 may also in- 
clude audio devices, including an audio input device 
930 for entering audio into the data processing sys- 
tem 900 and an audio output device 932 for reproduc- 
ing audio. The data processing system 900 may also 
include communication de vices, including a commu- 
nications port 934 for communicating with another 
system and a network port 932 for communicating 
with a network. 



Claims 

1. A method of providing automatic detection and 
processing of an empty multimedia data object, 
comprising the steps of: 

determining a data type of a multimedia data ob- 
ject; and 

detecting if the multimedia data object is an emp- 
ty multimedia data object based upon the data 
type. 

2. The method of claim 1, wherein the step of de- 
tecting if the multimedia data object is an empty 
multimedia data object, comprises the steps of: 
separating the multimedia data object into com- 
ponents; and 

detecting if a component of the multimedia data 
object is empty based upon the data type. 

3. The method of claim 2, wherein the step of de- 
tecting of a component of the multimedia data ob- 
ject is empty based upon the data type, further 
comprises the steps of: 

selecting an information characteristic of the 
component of the multimedia data object, based 
on the data type; 

measuring the information characteristic of the 
component of the multimedia data object, to gen- 
erate an information measurement; and 
comparing the information measurement to a 
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threshold. 

4. The method of claim 3, wherein the multimedia 
5 data object is a text type multimedia data object, 

and wherein the step of detecting if a component 
of the multimedia data object is empty based 
upon the data type, further comprises the steps 
of: 

10 counting characters, in the component of the text 

type multimedia data object, which are not a 
space and which are not a control character, to 
accumulate a character count; and 
comparing the character count to a threshold. 

15 

5. The method of claim 3, wherein the multimedia 
data object is a non-text image type multimedia 
data object, and wherein the step of detecting if 
a component of the multimedia data object is 

20 empty based upon the data type, further com- 

prises the steps of: 

counting pixels, in the component of the non-text 
image type multimedia data object, which are not 
a white pixel and which are not a low grey scale 
25 pixel, to accumulate a pixel count; and 

comparing the pixel count to a threshold. 

6. The method of claim 3, wherein the multimedia 
data object is a text image type multimedia data 

30 object, and wherein the step of detecting if a com- 

ponent of the multimedia data object is empty 
based upon the data type, further comprises the 
steps of: 

counting pixels, in the component of the text type 
35 image multimedia data object, which are not a 

white pixel and which are not a low grey scale pix- 
el, to accumulate a pixel count; and 
comparing the pixel count to a threshold. 

40 7. The method of claim 3, wherein the multimedia 
data object is a text image type multimedia data 
object, and wherein the step of detecting rf a com- 
ponent of the multimedia data object is empty 
based upon the data type, further comprises the 

45 steps of: 

converting the component of the text image type 
multimedia data object into a text type multimedia 
data object component, by use of optical charac- 
ter recognition; 

50 counting characters, in the text type multimedia 

data object, which are not a space and which are 
not a control character, to accumulate a character 
count; and 

comparing the character count to a threshold. 

55 

8. The method of claim 3, wherein the multimedia 
data object is a video type multimedia data object, 
and wherein the step of detecting if a component 
of the multimedia data object is empty based 

9 
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upon the data type, further comprises the steps 
of: 

calculating a randomness of the component of 
the video type multimedia data object; and 
comparing the randomness to a threshold. 

9. The method of claim 3, wherein the multimedia 
data object is a video type multimedia data object, 
and wherein the step of detecting if a component 
of the multimedia data object is empty based 
upon the data type, further comprises the steps 
of: 

comparing the component of the video type mul- 
timedia data object to a noise pixel pattern, by use 
of pattern recognition to produce a match score; 
and 

comparing the match score to a threshold. 

10. The method of claim 3, wherein the multimedia 
data object is a video type multimedia data object, 
and wherein the step of detecting if a component 
of the multimedia data object is empty based 
upon the data type, further comprises the steps 
of: 

calculating a frequency spectrum of the compo- 
nent of the video type multimedia data object; 
comparing the frequency spectrum to a frequen- 
cy spectrum of a video noise pixel pattern, by use 
of pattern recognition to produce a match score; 
and 

comparing the match score to a threshold. 

11. The method of claim 3, wherein the multimedia 
data object is an audio type multimedia data ob- 
ject, and wherein the step of detecting if a com- 
ponent of the multimedia data object is empty 
based upon the data type, further comprises the 
steps of: 

calculating an average amplitude of the compo- 
nent of the audio type multimedia data object; 
and 

comparing the average amplitude to a threshold. 

12. The method of claim 3, wherein the multimedia 
data object is an audio type multimedia data ob- 
ject, and wherein the step of detecting if a com- 
ponent of the multimedia data object is empty 
based upon the data type, further comprises the 
steps of: 

calculating an average power of the component 
of the audio type multimedia data object; and 
comparing the average power to a threshold. 
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steps of: 

calculating a frequency spectrum of the compo- 
nent of the audio type multimedia data object; 
comparing the frequency spectrum to a frequen- 
cy spectrum of an audio noise pattern, by use of 
pattern recognition to produce a match score; 
and 

comparing the match score to a threshold. 



14. The method of claim 1, further comprising the 
step of: 

selecting an appropriate processing of the multi- 
media data object if it is an empty multimedia data 
15 object. 

15. The method of claim 14, wherein the step of se- 
lecting an appropriate processing of the multime- 
dia data object if it is an empty multimedia data 

20 object, further comprises the step of: 

deleting the multimedia data object 

16. The method of claim 14, wherein the step of se- 
lecting an appropriate processing of the multime- 

25 dia data object if it is an empty multimedia data 

object, further comprises the step of: 
inhibiting further processing of the multimedia 
data object. 

30 17. The method of claim 14, wherein the step of se- 
lecting an appropriate processing of the multime- 
dia data object if it is an empty multimedia data 
object, further comprises the step of: 
notifying that the multimedia data object is emp- 

35 ty. . 

18. An apparatus for providing automatic detection 
and processing of an empty multimedia data ob- 
ject, comprising: 

40 means for determining a data type of a multime- 

dia data object; and 

means for detecting if the multimedia data object 
is an empty multimedia data object based upon 
the data type. 

45 

1 9. The apparatus of claim 1 8, wherein the means for 
detecting if the multimedia data object is an emp- 
ty multimedia data object, further comprises: 
means for separating the multimedia data object 

50 into components; and 

means for detecting if a component of the multi- 
media data object is empty based upon the data 
type. 



13. The method of claim 3, wherein the multimedia 55 20. The method of claim 19, wherein the means for 



data object is an audio type multimedia data ob- 
ject, and wherein the step of detecting if a com- 
ponent of the multimedia data object is empty 
based upon the data type, further comprises the 



detecting if a component of the multimedia data 
object is empty based upon the data type, further 
comprises: 

means for selecting an information characteristic 
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of the component of the multimedia data object, 
based on the data type; 

means for measuring the information character- 
istic of the component of the multimedia data ob- 
ject, to generate an information measurement; 
and 

means for comparing the information measure- 
ment to a threshold. 

21. The apparatus of claim 20, wherein the multime- 
dia data object is a text type multimedia data ob- 
ject, and wherein the means for detecting if a 
component of the multimedia data object is emp- 
ty based upon the data type, further comprises: 
means for counting characters, in the component 
of the text type multimedia data object, which are 
not a space and which are not a control character, 
to accumulate a character count; and 

means for comparing the character count to a 
threshold. 

22. The apparatus of claim 20, wherein the multime- 
dia data object is a non-text image type multime- 
dia data object, 

and wherein the means for detecting if a compo- 
nent of the multimedia data object is empty based 
upon the data type, further comprises: 
means for counting pixels, in the component of 
the non-text image type multimedia data object, 
which are not a white pixel and which are not a low 
grey scale pixel, to accumulate a pixel count; and 
means for comparing the pixel count to a thresh- 
old. 

23. The apparatus of claim 20, wherein the multime- 
dia data object is a text image type multimedia 
data object, and wherein the means for detecting 
if a component of the multimedia data object is 
empty based upon the data type, further com- 
prises: 

means for counting pixels, in the component of 
the text type image multimedia data object which 
are not a white pixel and which are not a low grey 
scale pixel, to accumulate a pixel count and 
means for comparing the pixel count to a thresh- 
old. 

24. The apparatus of claim 20, wherein the multime- 
dia data object is a text image type multimedia 
data object, and wherein the means for of detect- 
ing if a component of the multimedia data object 
is empty based upon the data type, further com- 
prises: 

means for converting the component of the text 
image type multimedia data object into a text type 
multimedia data object component, by use of opt- 
ical character recognition; 
means for counting characters, in the text type 



multimedia data object, which are not a space 
and which are not a control character, to accumu- 
late a character count; and 
5 means for comparing the character count to a 

threshold. 

25. The apparatus of claim 20, wherein the multime- 
dia data object is a video type multimedia data ob- 

10 ject and wherein the means for detecting if a 
component of the multimedia data object is emp- 
ty based upon the data type, further comprises: 
means for calculating a randomness of the com- 
ponent of the video type multimedia data object; 

15 and 

means for comparing the randomness to a 
threshold. 

26. The apparatus of claim 20, wherein the multime- 
20 dia data object is a video type multimedia data ob- 
ject and wherein the means for detecting if a 
component of the multimedia data object is emp- 
ty based upon the data type, further comprises: 
means for comparing the component of the video 

25 type multimedia data object to a noise pixel pat- 

tern, by use of pattern recognition to produce a 
match score; and 

means for comparing the match score to a 
threshold. 

30 

27. The apparatus of claim 20, wherein the multime- 
dia data object is a video type multimedia data ob- 
ject, and wherein the means for detecting if a 
component of the multimedia data object is emp- 

35 ty based upon the data type, further comprises: 

means for calculating a frequency spectrum of 
the component of the video type multimedia data 
object; 

means for comparing the frequency spectrum to 
40 a frequency spectrum of a video noise pixel pat- 

tern, by use of pattern recognition to produce a 
match score; and 

means for comparing the match score to a 
threshold. 

45 

28. The apparatus of claim 20, wherein the multime- 
dia data object is an audio type multimedia data 
object and wherein the means for detecting if a 
component of the multimedia data object is emp- 

50 ty based upon the data type, further comprises: 
means for calculating an average amplitude of 
the component of the audio type multimedia data 
object; and 

means for comparing the average amplitude to a 
55 threshold. 

29. The apparatus of claim 20, wherein the multime- 
dia data object is an audio type multimedia data 
object, and wherein the means for detecting if a 
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component of the multimedia data object is emp- 
ty based upon the data type, further comprises: 
means for calculating an average power of the 
component of the audio type multimedia data ob- 5 
ject; and 

means for comparing the average power to a 
threshold. 

30. The apparatus of claim 20, wherein the multime- 10 
dia data object is an audio type multimedia data 

« object, and wherein the means for detecting if a 
component of the multimedia data object is emp- 
ty based upon the data type, further comprises: 
means for calculating a frequency spectrum of 15 
the component of the audio type multimedia data 
object; 

means for comparing the frequency spectrum to 
a frequency spectrum of an audio noise pattern, 
by use of pattern recognition to produce a match 20 
score; and 

means for comparing the match score to a 
threshold. 

31. The apparatus of claim 18, further comprising: 25 
means for selecting an appropriate processing of 

the multimedia data object if it is an empty multi- 
media data object. 

32. The apparatus of claim 31 , wherein the means for 30 
selecting an appropriate processing of the multi- 
media data object if it is an empty multimedia data 
object, further comprises: 

means for deleting the multimedia data object. 

35 

33. The apparatus of claim 31 , wherein the means for 
selecting an appropriate processing of the multi- 
media data object if it is an empty multimedia data 
object, further comprises: 

means for inhibiting further processing of the 40 
multimedia data object. 

34. The apparatus of claim 31, wherein the means for 
selecting an appropriate processing of the multi- 
media data object if it is an empty multimedia data 45 
object, furt her comprises: 

means for notifying that the multimedia data ob- 
ject is empty. 

50 
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